HiDeNN-TD: Reduced-order hierarchical deep learning neural networks
نویسندگان
چکیده
This paper presents a tensor decomposition (TD) based reduced-order model of the hierarchical deep-learning neural networks (HiDeNN). The proposed HiDeNN-TD method keeps advantages both HiDeNN and TD methods. automatic mesh adaptivity makes more accurate than finite element (FEM) conventional proper generalized (PGD) TD, using fraction FEM degrees freedom. work focuses on theoretical foundation method. Hence, accuracy convergence have been studied theoretically numerically, with comparison to different methods, including FEM, PGD, Deep Neural Networks. In addition, we shown that PGD/TD converges at increasing modes, solution error is summation discretization mode reduction error. shows high orders magnitude fewer freedom hence potential achieve fast computations level for large-size engineering scientific problems. As trade-off between efficiency, propose highly efficient strategy called HiDeNN-PGD. Although less HiDeNN-TD, HiDeNN-PGD still provides higher only small amount additional cost PGD.
منابع مشابه
Learning hierarchical categories in deep neural networks
A wide array of psychology experiments have revealed remarkable regularities in the developmental time course of human cognition. For example, infants generally acquire broad categorical distinctions (i.e., plant/animal) before finer-scale distinctions (i.e., dog/cat), often exhibiting rapid, or stage-like transitions. What are the theoretical principles underlying the ability of neuronal netwo...
متن کاملLearning hierarchical category structure in deep neural networks
Psychological experiments have revealed remarkable regularities in the developmental time course of cognition. Infants generally acquire broad categorical distinctions (i.e., plant/animal) before finer ones (i.e., bird/fish), and periods of little change are often punctuated by stage-like transitions. This pattern of progressive differentiation has also been seen in neural network models as the...
متن کاملHigh-order Deep Neural Networks for Learning Multi-Modal Representations
In multi-modal learning, data consists of multiple modalities, which need to be represented jointly to capture the real-world ’concept’ that the data corresponds to (Srivastava & Salakhutdinov, 2012). However, it is not easy to obtain the joint representations reflecting the structure of multi-modal data with machine learning algorithms, especially with conventional neural networks. This is bec...
متن کاملHierarchical Cloth Simulation using Deep Neural Networks
Fast and reliable physically-based simulation techniques are essential for providing flexible visual effects for computer graphics content. In this paper, we propose a fast and reliable hierarchical cloth simulation method, which combines conventional physically-based simulation with deep neural networks (DNN). Simulations of the coarsest level of the hierarchical model are calculated using con...
متن کاملOnline Deep Learning: Learning Deep Neural Networks on the Fly
Deep Neural Networks (DNNs) are typically trained by backpropagation in a batch learning setting, which requires the entire training data to be made available prior to the learning task. This is not scalable for many real-world scenarios where new data arrives sequentially in a stream form. We aim to address an open challenge of “Online Deep Learning” (ODL) for learning DNNs on the fly in an on...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Computer Methods in Applied Mechanics and Engineering
سال: 2022
ISSN: ['0045-7825', '1879-2138']
DOI: https://doi.org/10.1016/j.cma.2021.114414